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ABSTRACT 

Knowledge  workers  need  to  find  information  but  even 
when  it  is  stored  on  their  local  computer  systems,  finding  it 
can  be  costly.  There  are  many  researchers  working  on  solu¬ 
tions  to  reduce  these  costs,  but  there  has  been  little  research 
into  exactly  what  these  costs  are,  and  what  the  ties  are  be¬ 
tween  these  costs  and  users’  choices  between  ways  to  ac¬ 
cess  their  local  information.  This  paper  provides  a  method¬ 
ology  for  investigating  such  issues,  and  reports  empirical 
results  on  ways  of  accessing  local,  task-relevant  resources 
(e.g.  document  files),  their  associated  costs,  and  users’  sen¬ 
sitivities  to  certain  kinds  of  costs.  Our  results  fill  in  gaps  in 
what  has  been  known  about  the  problem,  thereby  helping  to 
inform  research  on  solutions  to  the  problem. 
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INTRODUCTION 

Computer  users  who  spend  considerable  time  processing 
information  (termed  knowledge  workers  in  this  paper)  ac¬ 
cess  a  significant  amount  of  digital  information  in  the 
course  of  doing  their  jobs.  The  type  of  information  they 
access  that  is  of  interest  in  this  paper  is  the  information 
stored  in  files  and  folders  (termed  resources)  on  the  user’s 
computer  or  local  area  network. 

The  task  of  accessing  such  resources  is  often  not  a  simple 
one,  in  part  because  knowledge  workers  work  with  infor¬ 
mation  that  may  not  be  organized  according  to  their  current 
tasks  —  or  not  even  be  very  well  organized  by  any  criterion 


(e.g.,  Figure  1).  Although  several  research  efforts  have 
helped  to  shed  light  on  user  processes  for  organizing  and 
retrieving  information  [1,  24,  25],  and  the  difficulties  they 
run  into  along  the  way  [2,  8,  21,  22,  27],  these  works  have 
not  attempted  to  quantify  the  cost  of  these  processes  and 
difficulties. 

In  response  to  the  reported  difficulties  users  have  in  access¬ 
ing  their  resources,  there  have  been  several  research  efforts 
to  help  users  better  organize  and  retrieve  information  [3,  12, 
14,  18,  19,  22,  29,  32].  This  has  led  to  a  proliferation  of 
different  approaches  to  support  access  to  resources. 

We  would  like  to  help  inform  these  efforts  to  reduce  users’ 
costs  by  providing  insights  into  how  high  these  costs  to  the 
user  actually  are,  and  to  what  extent  different  aspects  of 
cost  relate  to  the  choices  users  make.  To  enable  this  sort  of 
investigation,  in  this  paper  we  present  a  cost-centric  meth¬ 
odology  for  investigating  issues  in  accessing  resources. 

We  further  present  empirical  results  of  a  study  that  uses  this 
methodology.  We  report  on  which  of  the  many  ways  to 
access  resources  the  users  actually  employed  and  their  as¬ 
sociated  costs,  whether  users’  choices  seemed  to  be  pre¬ 
dicted  by  users’  perceptions  of  cost,  and  how  perceived, 
optimal,  and  actual  costs  related  to  each  other.  In  consider¬ 
ing  these  questions,  our  aim  is  to  help  provide  a  better  un¬ 
derstanding  of  the  problem  of  local  resource  access,  so  as  to 
inform  research  into  possible  solutions. 


Figure  1.  One  of  our  authors’  desktop. 
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RELATED  WORK 
Finding  Files 

Our  work  builds  on  the  findings  of  previous  researchers 
who  have  investigated  the  preferences  and  habits  of  people 
attempting  to  access  local  information,  and  how  well  their 
habits  align  with  the  mechanisms  available.  For  example, 
numerous  studies  have  found  that  people  rely  heavily  on  the 
classification  of  information  into  folders  to  facilitate  re¬ 
trieval,  preferring  manual  browsing  of  the  file  structure 
over  logical  search  tools  [2,  21,  27].  One  reason  for  this 
may  be  that  users  navigate  to  a  desired  file  in  small  steps 
using  context  as  guide  [33].  Furthermore,  Kaptelinin  found 
that  users  employed  a  limited  number  of  manual  browsing 
techniques  [23]. 

These  results  point  to  the  need  for  different  access  methods 
that  may  be  more  appealing  to  these  users.  Toward  this  end, 
various  approaches  for  personal  information  management 
that  do  not  rely  on  hierarchically  structured  file  systems 
have  been  proposed.  For  example,  one  organization  scheme 
is  the  “pile”  or  “data  mountain”,  a  loosely  structured  infor¬ 
mation  collection  [13,  30].  Another  approach  is  to  show 
information  in  a  time-centric  visualization  [15,  28]. 

Time-centric  organizations  have  the  advantage  of  allowing 
the  worker  to  return  to  records  of  past  work,  but  for  multi¬ 
tasking  workers,  a  single  timeline  of  all  activity  is  a  jumble 
of  multiple  tasks.  The  importance  of  units  of  work  such  as 
projects,  activities,  and  to-do  items  (which  we  will  call 
tasks)  to  the  knowledge  worker  has  been  recognized  [1,  17]. 
Tasks  are  commonly  employed  by  knowledge  workers  to 
organize  information  they  are  working  on  [7].  Various  tools 
have  been  developed  to  support  grouping  information  in 
task-centric  workspaces  [6,  14,  19,  22,  29,  32]. 

Further  information  on  the  specific  costs  that  users  incur 
can  help  these  efforts  to  minimize  costs.  The  contribution  of 
this  paper,  then,  is  measuring  and  comparing  the  users’  ac¬ 
tual  costs  and  their  perceived  costs  of  resource  access 
methods  in  order  to  provide  a  baseline  understanding  of  the 
problem  space.  This  richer  knowledge  can  inform  the  con¬ 
text  of  research  into  more  efficient  solutions  for  local  in¬ 
formation  retrieval. 

User  Costs 

One  proposed  cognitive  model  for  analyzing  decisions  is 
the  Attention  Investment  Model  [5],  and  its  cost  basis  aligns 
well  with  our  experiment’s  goals.  This  predictive  model 
describes  how  users  decide  to  allocate  their  attention  by 
conducting  a  cost-risk-benefit  analysis  during  problem¬ 
solving,  in  which  the  units  they  are  weighing  up  are  the  cost 
of  their  attention  (closely  related  to  time).  The  expected 
benefit  of  an  action  is  compared  to  the  investment  required 
and  to  the  possible  risks  that  the  cost  may  be  paid  without 
receiving  the  expected  benefits  after  all.  The  Attention  In¬ 
vestment  Model  will  serve  as  an  intellectual  framework  in 
our  investigation  into  how  people  make  choices  among 
ways  to  access  resources. 


Note  that  the  Attention  Investment  Model  focuses  on  per¬ 
ceived  costs,  risks,  and  benefits.  This  aspect  of  the  model  is 
critical;  often,  users  make  choices  based  on  limited  infor¬ 
mation.  The  perceived  amount  of  benefit  includes  not  only 
the  immediate  benefit,  but  also  the  extent  to  which  the  user 
believes  that  their  investment  of  time  may  reduce  future 
costs.  Also,  the  users’  perception  of  costs,  risks,  and  bene¬ 
fits  may  be  influenced  by  their  past  experiences,  and  may 
have  little  to  do  with  the  actual  costs,  risks,  and  benefits. 

Closely  related  to  the  Attention  Investment  Model  is  the 
Attentional  User  Interface  (AUI)  model  [20].  The  AUI 
model  also  draws  from  economic  models  of  attention  and 
investment.  The  AUI  model  takes  into  account  the  informa¬ 
tion  content  of  a  potential  interruption  by  the  computer 
(such  as  a  potential  notification  of  an  important  incoming 
email  message)  in  the  context  of  the  user’s  preferences  and 
his/her  current  and  recent  online  activities  as  detected  by 
sensors.  Although  the  AUI  model  does  not  consider  cogni¬ 
tive  activities  directly,  the  user’s  physical  activities  can  be 
regarded  as  indirect  clues  about  the  user’s  attention.  The 
AUI  model’s  purpose  is  to  predict  whether  and  how  the 
computer  should  interrupt  the  user.  From  the  perspective  of 
our  research,  this  is  a  critical  difference  between  the  AUI 
model  and  the  Attention  Investment  Model  —  the  Attention 
Investment  Model  considers  what  the  user  will  do  under 
specific  conditions,  whereas  the  AUI  model  considers  what 
the  computer  should  do.  Thus,  the  AUI  model  is  not  appli¬ 
cable  to  our  goal. 

EXPERIMENT  DESIGN 

To  investigate  how  people  access  local  resources  and  their 
reasons  for  choosing  different  ways  of  accessing  them,  we 
designed  our  observational  experiment  around  activities 
requiring  local  resources,  some  of  which  were  required 
more  than  once.  To  reflect  the  realities  of  many  work  envi¬ 
ronments,  we  included  a  mix  of  interrupted  and  uninter¬ 
rupted  activities.  Extensive  electronic  transcripts  of  user 
interaction  events  and  system  status  information  were  re¬ 
corded  automatically  by  measuring  devices  and  used  in  our 
analysis. 

Experimental  Task 

The  participants’  task  was  to  answer  up  to  40  questions 
about  the  U.S.  National  Aeronautics  and  Space  Administra¬ 
tion  (NASA).  A  question’s  role  was  to  represent  a  single 
activity  for  a  knowledge  worker;  hence,  questions  were 
designed  to  require  thought,  information  search,  and  finally 
information  communication. 

Each  question  required  information  from  one  or  more  of  the 
resources  (Word  and  Excel  files  stored  on  the  participant’s 
computer).  In  order  to  maximize  the  need  for  these  re¬ 
sources,  well-known  facts  about  NASA  were  avoided.  The 
files  were  named  and  organized  into  folders  by  a  non¬ 
technical  end  user  who  was  not  involved  in  the  experiment 
in  any  other  way. 


Figure  2.  Quiz  software:  Text  input  question. 

Questions  were  presented  sequentially  by  software  designed 
for  the  experiment  (Figure  2).  This  quiz  software  presented 
the  question  and  an  input  box  for  typing  in  the  text  answers 
or  a  set  of  radio  buttons  for  answering  multiple  choice  ques¬ 
tions.  The  software  prevented  participants  from  skipping 
questions.  The  starting  question  for  each  participant  was 
chosen  at  random  by  the  software. 

To  make  the  patterns  of  resource  needs  as  realistic  as  possi¬ 
ble,  we  designed  the  questions  so  that  three  resources  were 
key  resources.  These  files  provided  answers  or  partial  an¬ 
swers  to  approximately  half  the  questions  in  the  experi¬ 
ment.  This  design  choice  was  based  on  office  visits  we 
conducted  with  10  knowledge  workers  (office  workers  and 
educators,  not  software  developers)  in  which  we  learned 
that  they  had  a  small  set  of  resources,  usually  two  or  three, 
to  which  they  refer  repeatedly  and  frequently  during  a  sin¬ 
gle  activity. 

In  work  environments  in  which  we  have  particular  interest, 
users  have  multiple  tasks  and  interruptions.  To  model  this 
aspect  of  the  real  world  in  our  experiment,  certain  questions 
(randomly  selected  prior  to  the  experiment)  were  inter¬ 
rupted  after  the  participant  had  opened  a  predetermined 
number  of  resource  documents.  At  that  point,  the  partici¬ 
pant  was  forced  to  switch  to  another  question  (activity).  The 
number  of  resources  triggering  a  particular  question’s  inter¬ 
ruption  was  also  randomly  selected  prior  to  the  experiment. 
The  participants  did  not  know  which  questions  would  be 
interrupted.  Time  permitting,  the  interrupted  question  was 
reintroduced  later  in  the  experiment. 

Once  a  participant  had  submitted  an  answer  to  a  question, 
Windows  Explorer  (the  graphical  file  browser)  and  any 
open  resource  documents  were  closed  automatically,  so  that 
participants  would  have  to  explicitly  choose  them  again  if 
they  were  needed  later.  The  Word  and  Excel  applications 
themselves,  however,  were  left  running,  to  allow  the  possi¬ 
bility  of  using  the  Recent  List  in  the  File  menu  of  the  appli¬ 
cations  or  the  File  Open  Dialog  box  if  desired  by  the  par¬ 
ticipant. 

Experimental  Procedure 

Participants  began  by  filling  out  a  pre-session  background 
questionnaire,  and  were  then  led  through  a  brief  tutorial. 
During  the  tutorial  they  were  instructed  to  browse  through 
and  move  resource  documents  in  order  to  familiarize  them¬ 
selves  with  the  location  and  contents  of  the  resource  docu¬ 
ments.  By  opening  the  files  and  looking  at  their  contents, 


participants  also  populated  some  of  the  most-recently-used 
lists  in  the  system,  particularly  My  Recent  Documents  in 
the  Start  Menu,  and  the  Recent  List  in  Word  and  Excel.  In 
the  ensuing  15-minute  practice  session,  participants  worked 
with  practice  questions,  which  served  the  dual  purpose  of 
getting  participants  acquainted  with  the  quiz  software  and 
of  giving  them  a  purposeful  method  of  further  familiarizing 
themselves  with  the  content  and  location  of  the  resources. 
Participants  then  had  45  minutes  to  perform  the  main  ex¬ 
periment  task. 

After  the  45-minute  experiment  task,  participants  filled  out 
a  post-session  questionnaire,  in  which  they  were  asked  how 
they  usually  accessed  resources  in  the  Windows  environ¬ 
ment  and  what  they  perceived  the  cost  of  each  way  to  be.  In 
order  to  prevent  the  questionnaire  from  influencing  partici¬ 
pant  behavior  during  the  experiment,  these  questions  were 
included  in  the  post-session  questionnaire  rather  than  at  the 
start  of  the  experiment.  Although  this  design  choice  allows 
for  the  possibility  of  post-rationalization  by  participants,  in 
this  case  we  considered  this  to  be  the  less  prejudicial 
choice. 

Participants 

Participants  were  recruited  by  sending  announcements  to 
both  undergraduate  and  graduate  student  mailing  lists.  The 
participants  were  required  to  have  some  prior  computer 
experience,  including  using  computers  to  prepare  materials 
for  their  studies  or  work,  but  computer  science  majors  and 
students  with  upper-division  coursework  in  computer  sci¬ 
ence  were  excluded  from  participation.  Each  participant 
was  paid  $20.  Overall,  39  people  (22  women  and  17  men) 
took  part  in  the  study,  with  a  mean  3.28  grade-point  average 
(SD=0.49)  and  a  mean  9.09  years  of  computer  experience 
(SD=3.43). 

A  COST-CENTRIC  METHODOLOGY  FOR 
INVESTIGATING  RESOURCE  ACCESS 

Because  we  are  interested  in  how  users  managed  their  costs 
in  getting  to  their  local  resources,  we  required  an  investiga¬ 
tion  methodology  based  on  costs  and  that  also  allowed  con¬ 
sideration  of  perceived  costs.  The  methodology  we  present 
here  is  based  on  the  Attention  Investment  Model  for  that 
reason  and  consists  of  a  model  plus  three  measuring  de¬ 
vices.  These  devices,  which  are  described  in  detail  later, 
provide  data  to  instantiate  the  model.  They  were  a  measur¬ 
ing  device  for  the  ways  that  participants  chose  to  use,  a 
measuring  device  for  gathering  data  on  other  ways  that  they 
could  have  chosen,  and  a  measuring  device  for  gathering 
data  of  perceived  ways  reported  by  participants. 

The  Model:  Possible  Alternatives 

The  core  of  our  methodology  is  a  state-transition  model 
reflecting  all  the  states  and  transitions  relevant  to  accessing 
local  resources  that  we  have  been  able  to  discover  for  a 
standard  Windows  system.  The  state-transition  model  re¬ 
flects  possible  paths  a  user  can  take  through  this  state  space 
to  access  a  resource,  from  root  (deciding  what  first  step  to 
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use)  to  leaf  (finally  opening  the  desired  file).  Each  transi¬ 
tion  between  nodes  thus  represents  a  choice  available  to  the 
user  at  that  stage  as  to  how  to  proceed  next. 

The  model  explicitly  depicts  the  work  required  for  the  user 
to  access  a  local  resource,  which  can  sometimes  be  quite  a 
lot.  For  example,  consider  the  path  of  opening  a  file  using 
My  Recent  Documents  from  the  Start  menu  (Figure  3).  The 
frill  diagram  depicting  the  model  is  too  large  to  include 
here,  but  is  available  at  [Appendix  A].  In  this  paper,  we  use 
an  abbreviation  convention,  in  which  each  grey  node  is  a 
supernode  —  a  collapsed  version  of  several  nodes  and  tran¬ 
sitions.  Transitions  marked  Decide  denote  mental  opera¬ 
tions,  those  marked  Select  denote  physical  user  actions  such 
as  mouse  clicks  and  keypresses,  and  those  marked  Navigate 
are  a  shorthand  notation  indicating  that  both  a  mental  op¬ 
eration  to  decide  which  way  to  proceed  and  the  sequence  of 
physical  user  actions  to  reach  the  next  state  are  included. 

In  this  example,  first  the  user  decides  how  to  proceed  from 
the  top  level,  transitioning  to  the  Start  Menu  Chosen  state. 
The  user  then  takes  the  actions  to  activate  the  Start  Menu 
(Select  transition).  The  user  then  navigates  to  the  My  Re¬ 
cent  Documents  supernode.  There  are  then  three  more  tran¬ 
sitions  within  this  supernode  required  to  finally  get  the  file 
open.  At  any  time,  the  user  could,  of  course,  decide  to  try  a 
different  alternative.  This  is  depicted  in  the  figure  by  the 
Decide  transition  leading  out  of  the  largest  supemode  up  to 
the  top  level. 

We  needed  to  group  alternatives  that  had  only  trivial  differ¬ 
ences  into  classes  to  make  further  analysis  tractable  and 
useful.  These  classes  will  be  referred  to  as  alternatives  in 
this  paper.  To  perform  the  grouping,  we  selected  user  inter¬ 
face  components  which  play  a  high-level  function  in  allow¬ 
ing  access  to  resources  (in  contrast  to  low-level  functional 
components  such  as  checkboxes)  as  the  granularity  that 
could  form  the  basis  of  an  alternative.  That  is,  each  alterna¬ 
tive  is  an  initial  user  interface  state  paired  with  a  user  inter¬ 
face  component  that  is  reachable  from  this  initial  state  and 
which  may  lead  to  a  resource.  The  total  set  of  alternatives 
we  have  found  that  are  possible  within  the  Windows  envi¬ 
ronment  are  termed  possible  alternatives.  Not  all  possible 
alternatives  are  available  to  the  user  in  a  given  situation 
(e.g.,  a  resource  may  not  be  in  the  My  Recent  Documents 
list);  this  subset  of  possible  alternatives  is  termed  available 
alternatives.  The  choices  actually  made  by  the  user  are  their 
chosen  alternatives. 

This  model  is  quite  versatile  for  cost-based  investigation 
into  resource  access,  because  it  affords  a  variety  of  instan¬ 
tiations.  For  example,  it  can  be  used  with  a  GOMS-based 
[9]  approach  to  sum  up  the  transitions  (operators,  in  GOMS 
terminology)  and  the  times  that  have  been  empirically  es¬ 
tablished  for  these  operators  to  provide  estimates  of  likely 
completion  times  for  each  alternative. 

The  model  only  answers  questions  about  possible  alterna¬ 
tives.  Our  methodology  supplements  this  model-based  view 
by  drawing  on  observational  data  to  instantiate  the  model 


Figure  3.  States  and  transitions  involved  in  opening  a  file  using 
the  Start  Menu’s  My  Recent  Documents. 


with  respect  to  available  and  chosen  alternatives  and  their 
costs.  Hence,  a  set  of  measuring  devices  is  required  along¬ 
side  the  model  but  these  may  depend  on  specific  settings, 
such  as  computing  environments,  the  characteristics  of  user 
interaction  reporting  provided  within  the  environments  and 
the  listening  capabilities  of  the  measuring  device  instantia¬ 
tions.  We  have  developed  these  devices  for  our  experimen¬ 
tal  setting,  as  we  describe  next. 

Measuring  Device  1:  Chosen  Alternatives 

This  measuring  device  provided  data  on  chosen  alternatives 
and  a  calculation  of  their  actual  costs.  We  decided  to  use 
TaskTracer  [14]  to  record  each  participant’s  actions  and  the 
time  needed  to  complete  those  actions,  generating  an  elec¬ 
tronic  transcript  of  each  participant’s  session.  TaskTracer 
listened  in  on  all  user  interaction  events  such  as  keypresses, 
mouse  clicks,  and  window  focus  changes.  File  open  and 
close  events  were  also  recorded.  Although  the  implementa¬ 
tion  of  this  capability  may  seem  straightforward,  there  were 
a  number  of  technical  difficulties,  because  it  involved  col¬ 
lecting  events  from  several  different  applications  (Win¬ 
dows,  Word,  and  Excel).  These  applications  have  different 
conventions  as  to  which  events  they  report  and  how,  and 
substantial  implementation  effort  was  required  to  gather  all 
the  relevant  events.  For  this  reason,  selected  transcripts  of 
both  pilot  participants  and  the  main  experiment’s  partici¬ 
pants  were  manually  analyzed  to  ensure  that  all  relevant 
alternatives  were  either  reported  or  deducible  from  reported 
data. 

In  our  instantiation  of  the  measuring  device,  actual  costs  for 
individual  file  accesses  were  measured  in  seconds  elapsed 
from  the  time  of  the  first  interaction  event  in  the  electronic 
transcript  (state  in  the  model)  corresponding  to  the  moment 


the  participant  started  looking  for  a  file  (i.e.,  the  window 
focus  changed  from  the  quiz  software)  to  the  time  of  the  file 
open  event. 

Measuring  Device  2:  Other  Available  Alternatives 

The  second  measuring  device  provided  data  on  the  ‘‘roads 
not  taken”  —  alternatives  to  access  resources  that  a  partici¬ 
pant  did  not  use  in  each  situation  but  that  might  have  been 
cheaper.  The  model  makes  the  sequence  and  number  of 
steps  associated  with  all  possible  alternatives  explicit,  but 
since  it  does  not  take  the  participant’s  specific  context  into 
account,  it  cannot  alone  enumerate  which  of  those  possible 
alternatives  are  actually  available.  To  gather  data  on  avail¬ 
able  alternatives,  the  measuring  device  recorded  informa¬ 
tion  snapshots  at  each  time  a  new  question  had  been  posed 
by  the  quiz  software  and  each  time  the  participant  opened  a 
resource.  This  information  snapshot  included  extensive 
system  state  information,  such  as  files  present  in  My  Recent 
Documents,  files  present  in  the  Recent  Lists  of  each  tracked 
application,  files  present  in  My  Documents,  current  folder  in 
the  File  Open  Dialog  box,  and  so  on.  The  information  snap¬ 
shots  were  stored  alongside  the  electronic  transcript  of  user 
behavior. 

This  measuring  device  provided  data  on  available  alterna¬ 
tives  and  formed  the  basis  for  a  calculation  of  optimal  costs 
—  the  costs  of  the  least  expensive  alternatives  a  participant 
could  have  chosen  to  access  a  particular  resource  at  a  par¬ 
ticular  moment.  Given  an  alternative  available  in  a  situation 
(discerned  from  the  state  information  captured  by  the  in¬ 
formation  snapshot),  optimal  cost  was  computed  as  follows: 
the  available  alternative’s  state  in  the  model  was  located, 
and  the  number  of  mental  operations,  keypresses,  and 
mouse  clicks  to  get  to  it  from  the  initial  node  were  counted. 
These  operations  were  multiplied  by  the  established  times 
for  these  operations  [9],  and  then  the  total  times  were 
summed.  The  achievability  of  these  times  for  alternatives 
was  then  cross-checked,  both  by  comparison  to  participant 
times  when  they  actually  used  these  available  alternatives, 
and  by  asking  experienced  computer  users  otherwise  not 
involved  in  the  experiment  to  open  files  using  these  alterna¬ 
tives.  In  all  the  cross-checks,  the  humans  in  these  situations 
differed  from  the  GOMS-based  approach  by  no  more  than 
20%.  When  there  were  differences,  the  humans  were  faster, 
indicating  that  our  optimal  cost  estimates  were  conserva¬ 
tive.  Finally,  the  alternative  with  the  lowest  cost  yielded  the 
optimal  cost. 

Measuring  Device  3:  Participant-Reported  Alternatives 

This  measuring  device  enabled  the  calculation  of  perceived 
costs  and  frequency  of  previous  use.  We  employed  a  post¬ 
session  questionnaire  to  gather  information  about  partici¬ 
pants’  perceptions  of  the  alternatives  (available  in  [Appen¬ 
dix  C].  In  particular,  the  participants  were  asked  5-value 
Likert-scale  questions  about  how  frequently  they  used  each 
alternative  (never  to  always)  and  what  their  perceived  cost 
of  each  alternative  was  (very  easy  to  very  hard). 


RESULTS 

How  Many  Ways  Are  There?  (Analytical  Results) 

Accessing  a  file  involves  a  number  of  actions,  both  physical 
and  mental.  The  presence  of  mental  cost  is  not  surprising, 
but  the  number  of  alternatives  to  be  weighed  as  part  of  this 
mental  cost  is  surprising.  Our  state-transition  model  re¬ 
vealed  27  of  these  alternatives!  We  do  not  enumerate  all  of 
them  here  (see  [Appendix  B]  for  the  complete  list),  but  the 
ones  that  our  participants  actually  used  will  be  detailed 
shortly.  Clearly,  the  cost  of  making  the  decision  from 
among  so  many  different  alternatives  would  be  high,  even  if 
all  of  these  alternatives  were  known  to  the  user.  This  sug¬ 
gests  that  there  could  be  some  alternatives  that  the  user 
never  chooses,  which  we  will  investigate  next. 

Which  Alternatives  Were  Used? 

The  following  table  identifies  all  of  the  alternatives  that 
participants  actually  used  to  access  files  during  the  experi¬ 
ment  (Table  1).  Note  that  only  1 1  of  the  27  possible  alterna¬ 
tives  were  chosen  across  all  participants  during  the  study. 

As  the  table  shows,  participants  overwhelmingly  chose  to 
access  resources  through  alternatives  involving  Windows 
Explorer.  (These  results  also  mirror  the  proportion  of  indi¬ 
vidual  file  access  for  which  these  alternatives  were  used.) 


Alternatives 

Code 

Number 

Percent 

Windows  Explorer 
(existing  window) 

WE 

35 

89.74 

Windows  Explorer 
(Address  Bar) 

AB 

16 

41.02 

Windows  Explorer 
(My  Computer  on  Desktop) 

MC 

15 

38.46 

File  Open  Dialog 
(application) 

FO 

8 

20.51 

Recent  List 
(application) 

RL 

7 

17.94 

Windows  Search 
(Windows  Explorer) 

WX 

7 

17.94 

Windows  Explorer 
(Start  Menu) 

WM 

6 

15.38 

Windows  Explorer 
(folder  shortcut  on  Desktop) 

WD 

3 

7.69 

Windows  Explorer 
(Start  Menu  -  RUN) 

WR 

2 

5.12 

Windows  Search 
(Start  Menu) 

WS 

2 

5.12 

My  Recent  Documents 
(Start  Menu) 

RD 

1 

2.56 

Number:  Number  of  participants  (Total  =  39) 

Percent:  Percentage  of  participants  who  used  a  particular  alternative 


Table  1.  All  alternatives  used  during  experiment 
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More  importantly,  once  they  had  used  Windows  Explorer 
and  there  was  an  existing  window  for  it,  they  kept  returning 
to  it  (even  though  it  may  have  been  hidden). 

Discussion 

It  seems  that  the  Windows  Explorer  component  was  very 
attractive  to  participants,  which  is  consistent  with  previous 
findings  which  revealed  that  participants  preferred  strate¬ 
gies  that  gave  interactive  feedback  about  their  current  status 
towards  locating  a  file  [16,  33].  Although  all  of  the  alterna¬ 
tives  are  interactive,  Windows  Explorer  excels  in  this  re¬ 
gard  by  continually  keeping  users  apprised  of  the  context, 
which  may  help  to  explain  its  apparent  popularity. 

Note  that  some  alternatives  were  available  only  at  certain 
points.  For  example,  locating  a  file  through  the  My  Recent 
Documents  alternative  would  only  be  successful  if  this  re¬ 
source  had  been  opened  recently  enough  to  feature  in  the 
list.  In  the  words  of  the  Attention  Investment  Model  [5], 
attempting  such  alternatives  involved  a  risk  to  the  partici¬ 
pant  that  they  may  not  receive  the  benefit  of  locating  the 
file  using  that  alternative.  Further,  yet  higher  cost  would  be 
incurred  by  having  to  backtrack  and  choose  another  alterna¬ 
tive. 

The  alternatives  list  in  Table  1  is  useful  in  another  way  too, 
because  it  validates  that  the  model  included  in  our  method¬ 
ology  was  well-suited  to  our  purposes:  no  participant  used 
any  alternatives  beyond  the  ones  revealed  by  our  model  of 
possible  alternatives. 


RD  =  My  Recent  Documents  (Start  Menu) 

RL  =  Recent  List  (application) 

AB  =  Windows  Explorer  (Address  Bar) 

WE  =  Windows  Explorer  (existing  window) 

WD  =  Windows  Explorer  (folder  shortcut  on  Desktop) 

MC  =  Windows  Explorer  (My  Computer  on  Desktop) 

WM  =  Windows  Explorer  (Start  Menu) 

WR  =  Windows  Explorer  (Start  Menu  -  RUN) 

WS  =  Windows  Search  (Start  Menu) 

WX  =  Windows  Search  (Windows  Explorer) 

Figure  5.  Combinations  of  alternatives. 

ment.  An  edge  between  two  nodes  indicates  that  both  these 
alternatives  were  used  in  the  experiment  session  by  the 
same  participant.  The  thickness  of  the  edge  between  two 
alternatives  indicates  the  number  of  participants  who  chose 
this  combination  of  alternatives. 


What  Alternatives  Did  Individual  Participants  Use? 

Two  competing  expectations  we  had  prior  to  our  experi¬ 
ment  were  that  people  might  make  extensive  use  of  many 
alternatives  in  attempts  to  optimize  their  actual  “file  open” 
work,  or  that  they  might  always  stay  with  a  single  way  in 
order  to  optimize  their  decision  making  work.  However,  we 
were  wrong  on  both  counts.  Instead,  most  people  used  2  to 
3  alternatives  (mean=2.64)  (see  histogram  on  Figure  4). 

The  network  diagram  in  Figure  5  shows  whether  and  how 
often  a  particular  alternative  was  used  in  conjunction  with 
another  alternative.  Nodes  in  the  network  represent  the  1 1 
alternatives  that  were  used  by  participants  in  the  experi- 
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Figure  4.  Number  of  alternatives  used  by  participants. 


Discussion 

This  network  diagram  again  emphasizes  the  importance  of 
Windows  Explorer  to  the  participants  as  a  core  component 
for  accessing  resources.  Moreover,  it  reveals  an  application¬ 
centric  approach,  in  that  participants  tend  to  use  File  Open 
Dialog  (FO)  together  with  Recent  List  (RL)  in  that  applica¬ 
tion. 

In  fact,  it  appears  that  participants  had  certain  “constella¬ 
tions”  of  preferred  strategies.  There  were  also  “anti¬ 
constellations”  —  certain  combinations  of  alternatives  that 
were  almost  never  used  together.  For  example,  My  Recent 
Documents  (RD)  was  never  used  in  combination  with  any 
kind  of  Windows  Search  (WS  and  WX),  nor  with  any  desk¬ 
top  shortcuts  (MC  and  WD),  nor  with  File  Open  Dialog 
(FO).  The  constellations  may  explain  why  participants 
stayed  within  a  small  set  of  alternatives.  If  so,  this  in  turn 
suggests  that  new  ways  that  could  be  developed  may  never 
or  rarely  be  used,  if  they  do  not  fit  well  in  an  existing  con¬ 
stellation  or  catalyze  a  new  one. 

What  Did  Chosen  Alternatives  Cost? 

These  descriptions  of  participant  behavior  need  to  be  evalu¬ 
ated  in  light  of  the  reasons  for  the  choices  participants 
made.  Participants  narrowed  down  the  alternatives  that  they 
eventually  chose,  so  what  influenced  that  decision?  In 
Blackwell’s  terms  [5],  how  did  users  assess  costs  in  access¬ 
ing  resources? 
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FO  =  File  Open  Dialog  (application) 

RD  =  My  Recent  Documents  (Start  Menu) 

RL  =  Recent  List  (application) 

AB  =  Windows  Explorer  (Address  Bar) 

WE  =  Windows  Explorer  (existing  window) 

WD  =  Windows  Explorer  (folder  shortcut  on  Desktop) 
MC  =  Windows  Explorer  (My  Computer  on  Desktop) 
WM  =  Windows  Explorer  (Start  Menu) 

WR  =  Windows  Explorer  (Start  Menu  -  RUN) 

WS  =  Windows  Search  (Start  Menu) 

WX  =  Windows  Search  (Windows  Explorer) 


FO  RD  RL  AB  WE  WD  MC  WR  WM  WS  WX 


Figure  6.  Actual  cost  for  alternatives. 


To  answer  any  question  about  assessment  of  costs,  we  first 
examined  the  actual  cost  to  the  participant  of  the  chosen 
alternatives  (see  the  Measuring  Device  1 :  Chosen  Alterna¬ 
tives  section  for  how  actual  costs  were  calculated).  The  box 
plot  (Figure  6)  shows  the  average  actual  costs  for  each  al¬ 
ternative.  As  can  be  seen  from  the  figure,  searching  from 
the  Start  menu  or  from  Windows  Explorer  was  considerably 
more  costly  to  the  participants  than  other  alternatives. 


Consideration  of  Optimal  Costs 

Are  participants  making  choices  between  alternatives  based 
on  optimal  costs?  To  investigate  this,  we  compared  the  ac¬ 
tual  costs  that  participants  incurred  for  each  situation  in 
which  they  needed  to  access  a  resource  with  the  optimal 
costs  to  access  the  resource  in  the  same  situation  (see  the 
Measuring  Device  2:  Other  Available  Alternatives  section 
for  how  optimal  costs  were  calculated). 

Our  analysis  showed  that  there  was  no  significant  relation¬ 
ship  between  the  optimal  and  the  actual  costs  (linear  regres¬ 
sion,  p-value  =  0.4563,  F[l,37]  =  0.5667,  R2=0.01509). 
Participants  only  hit  optimal  38%  of  the  time  Most  of  the 
time,  participants  seemed  to  use  alternatives  even  when 
those  alternatives  were  not  the  optimal  ones.  For  example, 
Recent  List  and  My  Recent  Documents,  when  they  were 
available,  could  get  participants  to  the  files  in  only  a  small 
number  of  mouse  clicks  but  instead  other,  costlier  alterna¬ 
tives,  such  as  Windows  Explorer,  were  used. 

Discussion 

What  is  becoming  clear  through  our  results  is  that  optimal 
costs  and  actual  costs  were  not  related;  participants  made 
choices  that  were  not  linked  to  efficiency. 


Discussion 

Previous  research  [21,  23,  33]  has  indicated  that  users  pre¬ 
fer  manual  browsing  to  searching,  and  the  actual  costs  of 
these  alternatives  in  our  experiment  were  much  lower  (and 
less  variable)  than  alternatives  that  involved  searching.  It 
may  be  that  searching  was  not  used  due  to  lack  of  experi¬ 
ence  with  computers,  as  it  has  been  suggested  that  expertise 
is  a  critical  factor  for  using  logical  search  [27].  We  there¬ 
fore  asked  ourselves  whether  more  experienced  participants 
would  be  able  to  reduce  their  costs  by  making  better 
choices  in  their  alternatives. 

Is  Computer  Experience  a  Predictor  For  Reducing 
Actual  Costs? 

As  a  metric  for  the  prior  computer  experience  we  used  the 
number  of  years  a  person  has  been  using  computers,  calcu¬ 
lated  from  the  questionnaire  data  as  the  number  of  years  of 
“personal  use”,  or,  if  this  information  was  not  given,  the 
combined  years  of  use  in  “high  school”  and  “college”.  We 
excluded  one  obvious  outlier  from  our  analysis.  The  outlier 
was  a  person  who  worked  with  computers  for  over  30 
years,  whereas  the  rest  of  the  subjects  had  no  more  than  15 
years  of  experience.  The  statistical  tests  showed  that  there 
was  no  significant  predictive  relationship  between  prior 
computer  experience  and  the  average  actual  cost  (linear 
regression,  p-value=0.3757, 77[1,36]=0.8044,  R2=0.02186). 

Flence,  we  can  state  that  computer  experience  had  no  rela¬ 
tion  to  the  performance  of  accessing  resources  (i.e.,  partici¬ 
pants  with  more  computer  experience  were  not  quicker  than 
participants  with  less  computer  experience).  It  therefore 
appears  that  greater  computer  experience  did  not  lead  to 
choosing  better  alternatives. 


We  pause  here  to  point  out  the  benefit  in  using  our  method¬ 
ology  to  investigate  the  predictive  nature  of  costs:  it  pro¬ 
vides  a  systematic  way  of  evaluating  participants’  choices 
by  comparing  what  they  chose  and  what  they  should  have 
chosen  instead,  had  their  decisions  been  based  only  on  op¬ 
timal  costs.  This  permitted  analysis  based  on  what  the  op¬ 
timal  alternatives  actually  were,  instead  of  less  precise  (re¬ 
searcher  intuition-based)  notions  of  which  alternatives 
would  be  superior. 

Especially  when  coupled  with  the  other  results  we  have 
presented  up  to  this  point,  the  lack  of  relationship  between 
optimal  and  actual  costs  implies  that  there  were  other  rea¬ 
sons  influencing  the  choice  of  alternatives  more  strongly 
than  an  assessment  of  optimal  cost.  The  Attention  Invest¬ 
ment  Model  suggests  that  perceived  costs,  risks,  and  bene¬ 
fits  play  a  major  role  in  making  choices  and  that  these  may 
be  influenced  by  users’  past  experiences.  Therefore,  we 
decided  to  investigate  the  relationships  between  costs  that 
were  participant-reported  and  the  choices  that  they  made. 

The  Role  of  Participants’  Perception 

We  investigated  whether  participants’  past  experience  in¬ 
fluenced  their  choice  of  alternatives  by  performing  logistic 
regression.  This  statistical  technique,  which  is  based  on 
probabilities  expressed  as  odds,  assessed  if  perceived  costs 
or  frequency  of  previous  use  were  predictive  of  whether  an 
alternative  was  selected  during  the  experiment.  We  found 
that  neither  variable  (nor  interaction  between  them)  was 
predictive  of  the  choice  of  an  alternative,  with  the  exception 
of  Address  Bar.  For  this  alternative,  frequency  of  previous 
use  was  predictive  of  selecting  it  (logistic  regression,  p- 
value  =  0.0150).  The  odds  that  Address  Bar  would  be  cho¬ 
sen  during  the  experiment  by  participants  with  high  re- 
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ported  frequency  of  usage  were  4.25  times  the  odds  that  it 
would  be  used  by  those  with  low  usage  (95%  confidence 
interval  for  the  odds  ratio  is  1.23  to  13.65). 

Discussion 

The  finding  that  perceived  costs  and  frequency  of  previous 
use  bear  no  relation  to  choice  of  alternative,  at  first  glance, 
seems  to  contradict  what  has  been  previously  assumed.  For 
example,  it  has  been  suggested  that  people  use  inefficient 
procedures  because  they  have  frequently  used  these  proce¬ 
dures  in  the  past  [16].  Furthermore,  the  Attention  Invest¬ 
ment  Model  focuses  on  the  importance  of  participants’  per¬ 
ceptions.  Flowever,  we  suggest  that  what  our  result  reveals 
is  participants’  particular  sensitivity  to  learning  new  alter¬ 
natives  for  accessing  resources. 

Evidence  for  this  comes  from  the  fact  that  the  only  time  that 
previous  frequency  of  use  had  any  bearing  on  whether  that 
alternative  would  be  selected  was  in  the  case  of  Address 
Bar,  which  is  a  component  of  Windows  that  is  not  visible 
by  default.  What  we  have  not  yet  considered  is  that  there  is 
another  cost  to  participants  that  may  have  influenced  their 
decision  to  choose  certain  alternatives:  the  cost  of  investing 
in  learning  new  alternatives. 

Investment  In  Learning  As  a  Reason  For  Decision 

As  we  have  just  shown,  participants  were  strongly  inclined 
toward  some  “favorite”  set  of  alternatives  for  accessing 
their  resources,  and  stayed  within  that  set  of  favorites. 
These  results  agree  with  other  researchers  who  have  re¬ 
ported  a  similar  phenomenon.  For  example,  Carroll  and 
Rosson  have  pointed  out  that  the  users  often  use  inefficient 
strategies  even  when  more  efficient  strategies  exist  [10], 
which  they  explain  through  the  “paradox  of  the  active 
user.”  The  essence  of  this  paradox  is  that  users  often  do  not 
spend  the  time  needed  to  learn  new  features  because  they 
want  to  get  their  work  done  efficiently.  Yet,  if  they  spent 
the  time  to  learn  new  features,  they  might  get  their  work 
done  more  efficiently.  Furthermore,  users  may  attempt  to 
apply  prior  knowledge  to  every  new  situation,  thereby 
avoiding  the  cost  of  additional  learning  when  possible. 
Similar  to  Carroll  and  Rosson,  Bhavnani  and  John  [4]  ob¬ 
served  the  usage  of  inefficient  strategies  even  by  experts 
who  valued  efficiency.  Not  spending  time  to  learn  is  a 
common  theme  in  these  prior  studies.  This  is  also  in  keep¬ 
ing  with  Blackwell’s  Attention  Investment  model,  which 
models  such  decisions  as  cost-risk-benefit  tradeoffs. 

The  Attention  Investment  Model  suggests  that  users  will  be 
deterred  by  the  cost  of  learning  new  features,  even  when 
they  realize  that  there  may  be  better  ways  to  access  their 
resources.  This  kind  of  cost  is  termed  an  investment  in  the 
model,  because  ideally  it  will  produce  repeated  long-term 
benefits.  Further,  as  with  all  investments,  there  is  a  risk  of 
low  or  nonexistent  return  (such  as  when  a  feature  is  not 
helpful  or  the  user  doesn’t  succeed  in  learning),  thus  mak¬ 
ing  the  learning  investment  unattractive.  On  the  post¬ 
session  questionnaires  from  the  current  study,  several  par¬ 


ticipants  specifically  alluded  to  prior  or  expected  learning 
costs  and  risks.  For  example: 

Q:  Why  do  you  usually  use  these  ways  <the  ways  you  usu¬ 
ally  use>? 

“ Because  that  is  how  I  learned  and  it  is  easy.  ” 

"Because  I  am  not  familiar  with  other  ways.  ” 

“ Easy  to  use.  ” 

The  responses  we  obtained  suggest  satisfaction  with  the 
current  cost-risk-benefit  ratio  of  prior  investment  in  learn¬ 
ing,  implying  no  need  for  additional  learning  investment. 
The  Attention  Investment  Model  further  suggests  that  users 
would  be  unlikely  to  take  the  time  to  mentally  compare  a 
large  number  of  alternatives,  since  the  tradeoff  between 
time  savings  gained  from  performing  an  optimal  alternative 
and  the  time  spent  in  advance  on  mental  calculations  to 
locate  that  alternative  do  not  seem  worthwhile  (and  our 
findings  replicate  this).  These  various  cost  and  risk  factors 
sum  up  to  a  significant  obstacle.  Overcoming  this  obstacle 
is  a  challenge  to  any  new  technique  aimed  at  helping  users 
to  access  a  desired  resource. 

Behavior  Modification  Is  Possible 

Despite  the  difficulties  imposed  by  this  obstacle,  our  data 
revealed  some  surprising  evidence  that  it  is  possible  to 
overcome  it.  In  designing  this  experiment,  we  chose  to 
make  Address  Bar  visible  so  that  participants  could  use  that 
alternative  if  they  wanted  (Address  Bar  is  not  visible  by 
default  in  Windows).  The  result  of  this  was  that  Address 
Bar  was  visible  at  the  bottom  of  the  screen  with  its  initial 
contents  pointed  to  a  folder  on  a  local  disk  drive. 

In  our  study,  16  participants  (41.02%)  used  Address  Bar 
(available  in  the  Windows  Task  Bar),  even  though  that  al¬ 
ternative  was  the  least  popular  way  of  accessing  resources 
by  two  different  measures  from  the  post-session  question¬ 
naire  (Figure  7).  This  is  particularly  interesting  in  light  of 
the  fact  that  5  people  out  of  those  16  reported  that  they  did 
not  even  know  that  this  alternative  existed  prior  to  the  ex¬ 
periment.  Clearly,  for  these  5  people,  an  incentive  was  pre¬ 
sent  and  that  incentive  was  powerful  enough  to  overcome 
resistance  to  new  learning  costs  —  and  modified  their  be¬ 
havior. 


File  Open  Recent  List  Windows  My  Recent  Search  Tool  Address 

Dialog  (within  Explorer  Documents  Documents  Bar 

(within  application)  (Start 

application)  Menu) 

Alternatives 


Figure  7.  Popularity  of  Alternatives. 


Discussion 

Surprise-Explain-Reward  [34]  is  a  strategy  that  has  been 
successfully  used  in  software  to  attract  users’  attention  to 
unfamiliar  features.  It  attempts  to  arouse  the  user’s  curiosity 
about  a  potentially  surprising  new  feature;  he  or  she  can 
then  pursue  an  interest  in  the  feature  by  invoking  minimal¬ 
ist  forms  of  explanation  [11]  and,  potentially,  reap  rewards. 
The  way  Address  Bar  was  present  in  the  experiment’s  envi¬ 
ronment  was  an  instantiation  of  Surprise-Explain-Reward, 
although  the  designers  of  the  bar  probably  did  not  realize 
this.  The  surprise  was  Address  Bar,  which  some  of  these 
participants  had  never  seen  before.  The  minimalist  support 
available  was  in  the  form  of  an  editable  example,  and  be¬ 
cause  it  was  in  the  form  of  a  working  example,  reading  and 
experimenting  with  that  example  were  low-cost,  low-risk 
operations.  Finally,  for  some,  the  experiments  paid  off:  the 
necessary  file  was  accessed,  hence  delivering  a  reward. 
Once  they  had  this  positive  experience,  they  continued  to 
use  it  throughout  the  experiment. 

This  is  in  keeping  with  previous  successful  uses  of  the  Sur¬ 
prise-Explain-Reward  strategy  [34,  31],  suggesting  that 
making  a  low-cost  high-reward  alternative  visible  can  mo¬ 
tivate  users  to  employ  it,  when  they  otherwise  would  not 
have  even  realized  it  existed. 

CONCLUSION 

In  this  paper,  we  have  presented  the  results  of  our  investiga¬ 
tion  into  how  people  access  resources  stored  on  their  local 
computer  systems.  One  of  the  contributions  of  this  paper  is 
a  methodology  for  investigating  approaches  and  costs  of 
accessing  local  resources,  including  a  detailed  model  of 
possible  alternatives  and  cost  structures. 

Furthermore,  we  described  three  measuring  devices  that 
were  motivated  by  our  methodology,  which  we  then  instan¬ 
tiated  to  measure  alternatives  and  costs  of  resource  access: 
a  measuring  device  for  collecting  chosen  alternatives  and 
their  cost,  a  measuring  device  for  available  alternatives  and 
optimal  cost,  and  a  measuring  device  for  participant- 
reported  alternatives  and  costs. 

Our  study’s  results  showed  that  participants’  choices  as  to 
the  alternative  to  access  a  resource  were  not  related  to  either 
the  optimal  or  the  perceived  cost  of  that  alternative.  There 
are  27  alternatives  to  consider,  and  it  would  be  time  con¬ 
suming  for  a  user  to  consider  them  all.  Instead,  our  partici¬ 
pants  chose  only  a  few  alternatives  (typically  2  or  3).  Our 
findings  revealed  participants’  strong  preference  for  a  lim¬ 
ited  number  of  alternatives  that  have  low  risk  (in  being  able 
to  succeed  in  reaching  the  file)  and  incremental  reward 
(feedback  along  the  way).  The  cost  and  risk  of  learning  new 
alternatives  appeared  to  have  outweighed  participants’ 
sense  of  the  cost  and  benefit  improvements  of  actually  us¬ 
ing  them.  Hence,  another  of  our  contributions  is  a  data  point 
for  the  Attention  Investment  Model,  in  that,  in  a  situation 
involving  a  cost-risk-benefit  analysis,  participants’  per¬ 
ceived  cost  of  actually  using  the  alternatives  appeared  to  be 
outweighed  by  the  perceived  cost  of  learning  an  alternative. 


However,  it  was  possible  to  modify  their  behavior  from  this 
pattern,  attracting  them  to  lower-cost  alternatives  through 
an  instantiation  of  the  Surprise-Explain-Reward  strategy.  A 
critical  aspect  seems  to  be  to  alert  users  to  the  presence  of 
an  alternative  that  appears  to  have  a  low  learning  cost  and 
risk,  and  which  turns  out  to  also  deliver  low  actual  cost. 

These  results  reveal  that  implicit  assumptions  that  may  un¬ 
derlie  some  of  the  research  into  improving  these  costs  do 
not  hold.  In  particular,  since  our  participants  considered 
only  a  small  fraction  of  the  27  alternatives  possible,  it 
seems  unlikely  that  users  will  voluntarily  consider  such 
research’s  emerging  28th  alternative.  Thus,  three  challenges 
must  be  faced  by  research  into  alternatives  that  reduce  re¬ 
source  access  costs  for  users:  (1)  how  to  make  users  aware 
of  these  new  alternatives  in  a  way  that  does  not  increase 
their  already  too-high  overhead  costs;  (2)  how  to  communi¬ 
cate  low  learning  cost  and  low  risk  of  new  alternatives  — 
so  low  that  the  user  will  be  willing  to  try  them;  and  (3)  how 
to  maximize  the  chances  that  a  user’s  initial  experimenta¬ 
tion  with  new  alternatives  will  indeed  deliver  on  its  promise 
of  low  usage  cost,  so  that  the  user’s  learning  investment 
will  pay  off  and  provide  an  incentive  to  continue  to  use  new 
alternatives. 
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APPENDIX  A  -  STATE  TRANSITION  DIAGRAMS 


1.  Choose  another  alternative 


2.1  Desktop  chosen 
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2.2  Existing  Windows  Explorer  chosen 


2.4  Quick  Launch  Bar  chosen 


Navigate 


Navigate 


Folder  visible 


Select  icon 

f - — - > 

Quick  Launch 
Bar'  menu  visible 


Decide  1.  Choose  another 
alternative 


Document  visible 


.  Select  icon 


3.3  Open  file  from 
[  Windows  Explorer 


Select  icon 


2.5  Links  Toolbar  chosen 


Navigate 


Navigate 


Select  icon 

_ £_ _ „ 

Links  Toolbar 
menu  visible 


Decide  f  1 1.  Choose  another 
alternative 


Folder  visible 


Document  visible 


Select  icon 


3.3  Open  file  from 
Windows  Explorer 


Select  icon 


2.6  Existing  Application  Window  chosen 


2.7  Start  Menu  chosen 


2.8  Open  Application  from  “All  Programs” 


1 

_ 3 

> 

Navigate 

Menu  visible 

Navigate  i  r  Select  icon 

[  Menu  opened 

1 

r  Navigate 

_  ..  r  n 

Decide  ^  j  Choose  another 

|  Application  visible 

alternative 

V _ _ ) 
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,  Select  icon 

3.4  Open  file  from  Application  j 

2.9  Open  file  from  “RUN 


t 

_ 3 

> 

,  Input  text 

Path  entered  in  “RUN  •window” 

’ 

.  Select  icon 

V 

Decide  (  1.  Choose  another 

alternative 

V _ / 

r  ) 

3.3  Open  file  from 

Windows  Explorer 

3.1  Open  file  from  My  Recent  Documents 
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3.2  Open  file  from  My  Documents 
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3.3  Open  file  from  Windows  Explorer 


3.4  Open  file  from  Application 


Select  icon 


File  menu  opened 


, ,  Navigate 


Menu  items  visible 


Navigate 


Select  icon 


Select  icon 


*[File  Open  Dialog  Box  opened 


Recent  List  visible 


Navigate 


Document  visible 


Navigate 


^  Navigate 


Folder  /  Icons  in 
Places  Bar  visible 


Select  icon 


^  Navigate 


Navigate 


Select  icon 


Folder  opened 


Decide  Jl.  Choose  another 
alternative 
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3.5  Open  file  using  Search 


1 

> 

Select  icon 

Search  text  box  visible 

_ 3 

,  Inputtext 

Search  text  entered 

_ 3 

,  Select  icon 

"'l 

Decide  1-  Choose  another 

Search  Results  displayed 

alternative 

_ 3 

t  Navigate 

Document  visible 

Select  icon 

Action  Grammar 

Decide  -  M 
Navigate  -  (MP)* 

Select  icon  -  L  |  L  E  |  R  (P*  L  |  K*)  |  D  |  K*  (D  |  E  |  L  |  L  E  |  R  P*  L  |  R  K*) 
Input  text  -  K* 

Key 

M  -  Mental  operation 
P  -  Mouse  movement 
L  -  Left-click 
E  -  Enter 
R  -  Right  click 
K  -  Key  press 
D  -  Double  click 
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APPENDIX  B  -  27  WAYS  TO  GET  TO  A  FILE 


Alternative 

Number 

User  interface  state 

User  interface  component  reachable 
from  this  state 

1 

My  Documents  from  Desktop 

Click  through  folders 

2 

My  Documents  from  Desktop 

Choose  file  directly 

3 

My  Computer  from  Desktop 

Windows  Explorer 

4 

Open  new  Application  from  Desktop 

Recent  List 

5 

Open  new  Application  from  Desktop 

File  Open  Dialog 

6 

Folder  shortcut  from  Desktop 

Windows  Explorer 

7 

Desktop 

Choose  file  directly 

8 

My  Computer  from  Start  Menu 

Windows  Explorer 

9 

RUN  from  Start  Menu 

Windows  Explorer 

10 

My  Documents  from  Start  Menu 

Click  through  folders 

11 

My  Documents  from  Start  Menu 

Choose  file  directly 

12 

Open  application  from  Start  Menu 

Recent  List 

13 

Open  Application  from  Start  Menu 

File  Open  Dialog 

14 

Start  Menu 

Search 

15 

Start  Menu 

My  Recent  Documents 

16 

Address  Bar 

Windows  Explorer 

17 

Address  Bar 

Choose  file  directly 

18 

Open  folder  from  Quick  Launch 

Windows  Explorer 

19 

Quick  Launch 

Choose  file  directly 

20 

Open  folder  from  Links  Toolbar 

Windows  Explorer 

21 

Links  Toolbar 

Choose  file  directly 

22 

Existing  Windows  Explorer 

Choose  file  directly 

23 

Existing  Windows  Explorer 

Use  Favorites  menu 

24 

Existing  Windows  Explorer 

Search 

25 

Existing  Windows  Explorer 

Click  through  folders 

26 

Existing  Application 

Recent  List 

27 

Existing  Application 

File  Open  Dialog 

APPENDIX  C  -  POST  SESSION  QUESTIONNAIRE 


POST  SESSION  QUESTIONNAIRE 


Subject  Number: 


1.  Please  check  any  one  of  the  following: 


MENTAL  DEMAND 

How  much  mental  and  perceptual  activity  (e.g 
thinking,  deciding,  calculating,  remembering, 
looking,  searching  etc.)  was  required  to  answer 
the  questions? 


TEMPORAL  DEMAND 

How  much  time  pressure  did  you  feel  due  to  the 
rate  or  pace  at  which  the  questions  appeared? 


LOW  HIGH 


PERFORMANCE 

How  successful  do  you  think  you  were  in  answer¬ 
ing  the  questions? 


EFFORT 

How  hard  did  you  have  to  work  (mentally  or 
physically)  to  accomplish  your  level  of  perform¬ 
ance? 


FRUSTRATION  LEVEL 

How  insecure,  discouraged,  irritated,  stressed  and 
annoyed  versus  secure,  gratified,  content,  relaxed 
and  complacent  did  you  feel  while  answering  the 
questions? 


2.  How  do  you  usually  get  to  files  in  your  system? 
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3.  Besides  the  ones  you  listed  above,  do  you  ever  use  any  other  ways?  If  yes,  what  are  they? 


4.  Why  do  you  usually  use  the  ways  you  gave  in  Question  2? 


5.  What  helps  you  remember  where  your  files  are  in  the  system? 


6.  Which  was  more  difficult?  (Choose  one) 


a, 


etting  the  right  file 


□  r 


inding  the  information  within  the  file 


7.  How  do  you  store  files  that  belong  to  more  than  one  topic? 

(For  example,  if  you  have  payroll  information  about  students,  would  you  store  it  in  Payroll  folder,  students  folder,  or 
both,  or  some  other  way?) 


8.  Are  you  familiar  with  the  following  ways  to  access  files  in  MS  Windows  environment? 


Favorites  Ltet 

□  Yes  □  No 


.•  1 

□  t*r*ctv»« 


sii 


Search  Tool 
□  Yes  □  No 


C  •ody-H.. 

«j  ofand*  asM.dcc 
*4)  dimtm  v»r.  *< 

4*fi»A1^3«Ox 

MmMi  tmu  anci  Flri  4>: 

UW005.  l\rWr 
*3  l4>n4jM4X 
^3  W'w*C»©tU»Y<toc 

£  Pattern  wr*  _ 

«|3  ^hH.w 
*53  A  (rttjEPW.doc 
<53  ieMlte-  !*«o  d>: 
s5j  iIuV.imCUB.<VWi}.  d 


X  O  T7! 


C 


D*m  Vtodhad 

IftOS  14592 
IACI5  WSIS02 

i off.  >->-  ir-.-- 


U*lMcrM5 
iJNnora 
O  Mil*  tart* 
ONMfrt«S’fWW« 

_jt'***i  rf  hAlA 


*■-  O  e>wt 
*•  u  r»yti 
«  U>V5Qt-tC* 

-  LJ  H**A 

#  O 

•  kJttfifvWi 

a.  O  **»*»» 

♦  OHkS4A«CU 

*  ^ 3  **»v*»-cv<ert:-^f«u^« 

*  i_J  CUnvan  tact* 

a* 

*  J^CWMK 

«  ,_}  want t»ba  jwrt  r* NA.V1 
r  ,_j  1«*Tr«car 


levigate  tone  ra  in 
Windows  Explorer 
□  Yes  □  No 


i 


My  ftecent  Docurrenb 

□  tts  □  No 


KMfM  «>{«• 


■  tf  rux: 


ir-?  hnj.»K 


Cj'Msrt  t*  :<*f  Of  N&S* 


y  Sweh 


fc  '  Jtul  rit am*. 


tdwbfW't 


Uh>t« 


It*  VII 


Quick  Launch  E&r 
□  Yes  ONo 


Too  Its 


_inh3 


Address  Ear 
□  Yes  Duo 


Go  ®  G (<&  Q  fwjh  .k  Q  Hm  4x  0  Kratov 


’.'fwanti  «»i 
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9.  How  much  work  do  you  think  it  is  to  find  the  right  files  in  the  following  ways  (see  picture)? 


S&arch  Tool 

□  Very  easy 

□  &  v. 

□  Hmtftl 

□  rted 

□  Vary  hard 

□  Don't!  now 


C  •ody-t... 

«j  C+ndtt  3>M.dBc 

*4)  2Q«-«x 

<53  OxcScofe-dx 

MmMi  tmu  «nci  Flri ijx 
fJMOK.  |\dv 
<53  lataAibaldoc 
f*»*C»«cu»y*toc 
y  Minn  jav* 

<b)  fl«o<tjE^w.d« 

*53  ‘Seattle  l»:»vsdx 

gS)  it»»^.mCllW.^WO.ilK 


Favoritea  Liat 

□  Very  easy 

□  Eft* 

□  Mental 

□  H lard 

□  Very  hftrd 

□  Don’t  Ino  a 


»  ■ 


HD 


C 


Ottm  Vfcdftad 

iv  08  2006  1*582 
190*  an*  IS  02 

I  Off.  :v>-  ir-.-- 


r— r«Y 


Utototii 

iJHnora 

OMcws-Events-FeeiDifes 

kJO 

<*  W.3A 
Otaoc*9fc 

OwvetQbeMit^NftSA 


)  op* 

. ) 

^javsot.HTT 

a  U  has* 

W  LJ  Bui)/*! 

*  ij  tvnto  htfi 
tfe  O  *ftw*o»» 

*  OHftSAtou 

*  *tt»rf'>***f**}*tf 

*  Q  CUnvan  tact* 
a*  *ttyb  d  r»iA 

*  J^twaii 

i  -art  o»t»  (urt  r< NASA 

e  lawTrKn 


levigate  fobera  m 
Window  a  Explorer 

□  Verveasv 

□  Efts  > 

□  Meutd 

□  Hftrd 

□  Very  hard 

□  Don't  Ino  a 


My  Recent  Do  currents 

□  Verveas* 

□  Efts  v 

□  Meutd 

□  Hard 

□  Very  hard 

□  Don’t  Ino* 


HMmi  W*« 


Quick  Launch  E&r 

□  Very  easy 

□  Ea* 

□  Mental 

□  Hftrd 

□  Very  hftrd 

□  Don't  Ino  a 


y  Search 


Linka  Too  Iter 

□  .erven  s. 

□  &SV 

□  Mental 


Add  reaa  E&r 

□  Very  east 

□  Efts. 

□  Mental 

□  Hard 

□  Very  hard 

□  Don't  Ino  a 


0  Msca.5^ 


loulrtiaat 


;U*a«t»<pMh 


It*  *11 


,~7  6i\. 


Hird 


RMI 


LQJ  $»■*&> «vr. 


Don’t! 


j!  Vo>*  y  r-mk  >H  Q  Hjt«4x  □  Horefwoe 


.  'twjrnli  »>i  Srfftne* 


10.  How  frequently  do  you  use  these  different  ways  to  get  to  files  in  MS  Windows  environment? 


pa-w*  r.- 


S&arch  Tool 

□  Newer 

□  Seldom 


C  •ody-H.. 
sj  Cafandar  29M.dE* 

Otmim  wt.dw 
Mh  t'XtdX 

*53 

d]  MmMi  treuranca  Flri ijx 
UW005.  tidnc 
*3  Idfft&iMdOC 
dj3  wweC»oat»v<toc 
y  Minn  jav* 

*53  OertjE^w.doc  X, 

*J3  Seattle  l,>.c«o  dx 

g5*|  it»»^.mClff).drfl3.ilK 


Favorites  Lisrt 

□  Newer 

□  Seldom 

□  Som  dimes 

□  Often 

□  AJUByS 


»  ■ 


□  Sometimes  X 

□  Often 


C 


□  Alleys 


Data  Vfcdh-d 

ims  nos  iv-.. 
i*  os  nos  is « 

lore:  :v>~  ir--- 


^-v 


(JNoora 

v_j‘*»  siw»rMts  _,_ 
<*  KtWA 

OtaocMfc 

jj'Myy  to  t*  :eat  of  fan* 


)  V’tM* 

.  I 

^j»V5Qt.»r? 

V  u  H*3* 

W  Lj  Bud/tl 

•  tnito  M 
tb  O  *'■>*« 

♦  OHkStieacu 

•  uJ  **»v*»-cv<ert:-pf«is^« 

x  Q  CUnvan  tact* 

9  _J  *»ei*c  J  r*>:4 

* 

«  *<rt  :sh»  r^t  rt  HK'A 

e  ._j  1a*Tracar 


levigate  foklera  m 
Window  a  Explorer 

□  Newer 

□  S  eld  cm 

□  Sometime 

□  Often 

□  AJueys 


My  Recent  Lb  currents 

□  Newer 

□  SeJdan 

□  Scmetimes 

□  Often 

□  AJuays 


w*. 


Quch  Launch  E&r 

□  Newer 

□  Seldom 

□  Som  dines 

□  Often 

□  AJueys 


Links  Too  Iter 

□  Newer 

□  Seldom 

□  Scmetimes 


y  Stsych 


Add  reaa  ESr 

□  Newer 

□  Seldom 

□  Som  dines 

□  Often 

□  Aluays 


ttaca»J*44» 


fc  ;  ./xat  rtiarw t 


>i^Kb{Cwh 


it*  -ju 


,~7  Ifcrs. 


' 


LQJ 


“l.Mirr; 


4i  *  .:«*  a  CwAJh  £)  *Wt«5i>x  D 


.  fwjrnti  »>i  S*Mjr^» 
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11.  Please  check  any  one  of  the  following,  considering  the  interruptions. 


MENTAL  DEMAND 

How  much  mental  and  perceptual  activity  (e.g 
thinking,  deciding,  calculating,  remembering, 
looking,  searching  etc.)  was  required  when  you 
were  interrupted? 


FRUSTRATION  LEVEL 

How  insecure,  discouraged,  irritated,  stressed  and 
annoyed  versus  secure,  gratified,  content,  relaxed 
and  complacent  did  you  feel  when  you  were  inter¬ 
rupted? 


LOW  HIGH 


THANK  YOU 


